Ab>initio, Big Data, Informatica, Tableau, Data Architect, Cognos, Microstrategy, Healther Business Analysts, Cloud etc.

Responsibilities:

• Designing and implementing fine-tuned production ready data/ML pipelines in Hadoop platform.
• Driving optimization, testing and tooling to improve quality.
• Reviewing and approving high level & amp; detailed design to ensure that the solution delivers to the business needs and aligns to the data & analytics architecture principles and roadmap.
• Understanding business requirements and solution design to develop and implement solutions that adhere to big data architectural guidelines and address business requirements.
• Following proper SDLC (Code review, sprint process).
• Identifying, designing, and implementing internal process improvements: automating manual processes, optimizing data delivery, etc.
• Building robust and scalable data infrastructure (both batch processing and real-time) to support needs from internal and external users.
• Understanding various data security standards and using secure data security tools to apply and adhere to the required data controls for user access in the Hadoop platform.
• Supporting and contributing to development guidelines and standards for data ingestion.
• Working with a data scientist and business analytics team to assist in data ingestion and data related technical issues.
• Designing and documenting the development & deployment flow.

Requirements:

• Experience in developing rest API services using one of the Scala frameworks.
• Ability to troubleshoot and optimize complex queries on the Spark platform
• Expert in building and optimizing ‘big data’ data/ML pipelines, architectures and data sets.
• Knowledge in modelling unstructured to structured data design.
• Experience in Big Data access and storage techniques.
• Experience in doing cost estimation based on the design and development.
• Excellent debugging skills for the technical stack mentioned above which even includes analyzing server logs and application logs.
• Highly organized, self-motivated, proactive, and ability to propose best design solutions.
• Good time management and multitasking skills to work to deadlines by working independently and as a part of a team.

Technical Knowledge (Must Have)

• Strong experience in SQL / HiveQL/ AWS Athena,
• Strong expertise in the development of data pipelines (snaplogic is preferred).
• Design, Development, Deployment and administration of data processing applications.
• Good Exposure towards AWS and Azure Cloud computing environments.
• Knowledge around BigData, AWS Cloud Architecture, Best practices, Securities, Governance, Metadata Management, Data Quality etc.
• Data extraction through various firm sources (RDBMS, Unstructured Data Sources) and load to datalake with all best practices.
• Knowledge in Python
• Good knowledge in NoSQL technologies (Neo4J/ MongoDB)
• Experience/knowledge in SnapLogic (ETL Technologies)
• Working knowledge on Unix (AIX, Linux), shell scripting
• Experience/knowledge in Data Modeling. Database Development
• Experience/knowledge creation of reports and dashboards in Tableau/ PowerBI

Informatica PowerCenter (9x ,10.2) : Minimum 2+ years experience

SQL / PLSQL: Understanding of SQL procedure. Able to convert procedures into Informatica mapping.

Good to have- Advantage if you have knowledge of Windows Batch Script.

• upGrad was awarded the Best Tech for Education by IAMAI for 2018-19,
• upGrad was also ranked as one of the LinkedIn Top Startups 2018: The 25 most sought-after startups in India.
• upGrad was earlier selected as one of the top ten most innovative companies in India by FastCompany.
• We were also covered by the Financial Times along with other disruptors in Ed-Tech.
• upGrad is the official education partner for Government of India - Startup India program.
• Our program with IIIT B has been ranked #1 program in the country in the domain of Artificial Intelligence and Machine Learning.

• Work with Product Managers and Business to understand business/product requirements and vision.
• Provide a clear architectural vision in line with business and product vision.
• Lead a team of architects, developers, and data engineers to provide platform services to other engineering teams.
• Provide architectural oversight to engineering teams across the organization.
• Hands on design and development of platform services and features owned by self - this is a hands-on coding role.
• Define guidelines for best practices covering design, unit testing, secure coding etc.
• Ensure quality by reviewing design, code, test plans, load test plans etc. as appropriate.
• Work closely with the QA and Support teams to track quality and proactively identify improvement opportunities.
• Work closely with DevOps and IT to ensure highly secure and cost optimized operations in the cloud.
• Grow technical skills in the team - identify skill gaps with plans to address them, participate in hiring, mentor other architects and engineers.
• Support other engineers in resolving complex technical issues as a go-to person.

• 12+ years of experience in design and development of ecommerce scale systems and highly scalable SaaS or enterprise products.
• Extensive experience in developing extensible and scalable web applications with
  • Java, Spring Boot, Go
  • Web Services - REST, OAuth, OData
  • Database/Caching - MySQL, Cassandra, MongoDB, Memcached/Redis
  • Queue/Broker services - RabbitMQ/Kafka
  • Microservices architecture via Docker on AWS or Azure.
  • Experience with web front end technologies - HTML5, CSS3, JavaScript libraries and frameworks such as jQuery, AngularJS, React, Vue.js, Bootstrap etc.

• Extensive experience with cloud based architectures and how to optimize design for cost.
• Expert level understanding of secure application design practices and a working understanding of cloud infrastructure security.
• Experience with CI/CD processes and design for testability.
• Experience working with big data technologies such as Spark/Storm/Hadoop/Data Lake Architectures is a big plus.
• Action and result-oriented problem-solver who works well both independently and as part of a team; able to foster and develop others' ideas as well as his/her own.
• Ability to organize, prioritize and schedule a high workload and multiple parallel projects efficiently.
• Excellent verbal and written communication with stakeholders in a matrixed environment.
• Long term experience with at least one product from inception to completion and evolution of the product over multiple years.

• This job is on Contrecting role Max $70/hr 
   Java or Scala web developer with 8 to 12 years of experience and strong fundamentals/proficiency in core technologies used for web development - HTML, CSS, JavaScript, Spring and Hibernate (to include relational database experience). 

• Object oriented analysis and design patterns using Java/J2EE technologies, 

• Knowledge on Spring Framework, MVC architectures, ORM frameworks like Hibernate  

• Experience with Restful Web Services, data modeling  

• Strong experience in relational database design and development (preferably with Oracle) and understanding of NoSQL databases like HBase, Druid, Solr 

• Experience working with event/message-based communication platforms such as Kafka, ActiveMQ etc., 

• Experience working with Hadoop technologies and Spark framework  

• Working proficiency in build and development tools (Maven, Gradle, Jenkins) 

• Experience with test frameworks like JUnit, Mockito  

• Experience in front end development using modern JavaScript frameworks and charting frameworks

• You will be responsible for design, development and testing of Products
• Contributing in all phases of the development lifecycle

• Writing well designed, testable, efficient code
• Ensure designs are in compliance with specifications

• Prepare and produce releases of software components

• Support continuous improvement by investigating alternatives and technologies and presenting these for architectural review

• Some of the technologies you will be working on: Core Java, Solr, Hadoop, Spark, Elastic search, Clustering, Text Mining, NLP, Mahout and Lucene etc.